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Abstract 

t-H . 

. Due to the short and bursty incoming messages, channel access activities in a wireless random access system 

are often fractional. The lack of frequent data support consequently makes it difficult for the receiver to estimate 
and track the time varying channel states with high precision. This paper investigates random multiple access 
0^ ! communication over a compound wireless channel where channel realization is known neither at the transmitters 

nor at the receiver. An achievable rate and error probability tradeoff bound is derived under the non-asymptotic 
assumption of a finite codeword length. The results are then extended to the random multiple access system where 
q ' the receiver is only interested in decoding messages from a user subset. 

Index Terms 

channel coding, compound channel, finite codeword length, random access 
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I. Introduction 

In random multiple access communication, users (transmitters) determine their communication rates 
individually, without sharing the rate information either among each other or with the receiver [1]. With 
^ ■ the absence of rate coordination among users, reliable message recovery is not always possible [2]. The 
receiver in this case decodes the transmitted messages if a pre-determined error probability requirement 
can be satisfied, or reports a collision otherwise [1]. 

Information theoretic channel coding in time-slotted random multiple access communication over a 
discrete-time memoryless channel was recently investigated in [1][3]. Assume that channel coding is 
applied only within each time slot (or packet). It was shown in [1] that the fundamental performance 
limitation of the system can be characterized using an achievable rate region in the following sense. 
Asymptotically as the codeword length (or time slot length) is taken to infinity, the receiver is able to 
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recover the messages reliably if the communication rate vector (which includes the rates of all users) 
happens to be inside the rate region, and to reliably report a collision if the rate vector happens to be 
outside the region [1]. The achievable rate region was shown to coincide with the Shannon information rate 
region without a convex hull operation [1]. In [3], the asymptotic coding result was further strengthened 
to a rate and error probability tradeoff bound under the assumption of a finite codeword length. A bound 
on the achievable error exponent was obtained consequently [3]. 

Both [1] and [3] assumed that the channel state information is known at the receiver. Unfortunately, 
since random access communication deals with bursty short messages, transmission activities of a user 
are often fractional. Without frequent data support, accurate real-time channel estimation and tracking 
become difficult at the receiver. Understanding the system performance limitation without channel state 
information therefore becomes essential [4]. In this paper, we illustrate how coding theorems developed 
in [1][3] can be extended to random multiple access communication over a compound discrete-time 
memoryless channel [5] [6], consisting of a family (set) of channels over which the communication could 
take place. Both the transmitters and the receiver know about the compound channel set, but not the 
actual channel realization. As in [1][3], we assume that time is partitioned into slots of equal length, and 
we focus on channel coding within one time slot. We define the communication rate of a user as the 
normalized number of information nats encoded in a packet (or a time slot). 

The compound channel communication problem investigated in this paper is different from a con- 
ventional one in the following two key aspects. First, in a conventional system, information rates are 
jointly determined by the transmitters and the receiver [7], while communication rates in a random access 
system are determined distributively and the rate information is unknown at the receiver [1]. Second, 
in a conventional system, in order to achieve reliable communication, the transmitted rate vector should 
be supported by all channel realizations in the compound set [8] [4]. In random access communication, 
however, even though the receiver needs to guarantee the reliability of its decoding output, the receiver 
also has the additional choice of reporting a collision to avoid confusing the upper layer networking [9]. 
This therefore allows the transmitted rate vector to be supported only by a subset of channel realizations. If 
the actual channel realization belongs to this subset, the receiver should decode the messages. Otherwise, 
the receiver should report a collision. Clearly, the decoding and collision report decisions made at the 
receiver are affected jointly by the communication rates of the users and the actual channel realization. 

To address these key aspects in the system model, we assume that the receiver chooses an "operation 
region", which is a set of rate vector and channel realization pairs. If the transmitted rate vector and channel 
realization pair is within the operation region, the receiver intends to decode the messages, otherwise the 
receiver intends to report a collision (or outage). We define the decoding error probability and the collision 
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miss detection probability similarly to [3], and define the system error probability as the maximum of the 
two. An upper bound on the achievable system error probability is derived under the assumption of a finite 
codeword length. We then show how the compound channel results help in obtaining error performance 
bounds for the random multiple access system where the receiver is only interested in recovering messages 
from a user subset [1]. This is based on the observation that, conditioned on the receiver not decoding 
messages for the rest of the users, the impact of their communication activities on the user subset of 
interest is equivalent to that of a compound channel. 

II. Multiple Random Access Communication over A Compound Channel 

Consider a fT-user time-slotted random access system over a compound discrete-time memoryless 
channel. Time is slotted with each slot equaling N symbol durations, which is also the length of a packet 
or a codeword. We assume that channel coding is only applied within each time slot or packet. The 
compound channel consists of a family of discrete-time memoryless channels, characterized by a set of 
conditional probabilities {-Py-pri - x K i " ' ■> ^ypfi ■■■ x K } wmi cardinality H, where, for k G {1, • • • , K}, 
X k G X is the channel input symbol of user k with X being the finite input alphabet, and Y G y is the 
channel output symbol with y being the finite output alphabet. In each time slot, a channel realization 
is randomly generated from this set and remains static throughout the slot duration. We assume that all 
users and the receiver know the compound channel set, but not the actual channel realization. For the 
time being, we will assume that H < oo. The case when the compound channel set contains an infinite 
number of channels will be discussed at the end of this section. 

Assume that at the beginning of a time slot, according to the message availability and the MAC 
layer protocol, each user, say user k (k £ {1, ■ ■ ■ , K}) chooses an arbitrary communication rate r k G 
{ r k\i ■ ■ ■ , r kAi} m nats per symbol, where {r fel , • • • , r kM } is a pre-determined finite rate set of user k 
with cardinality M . Neither the other users nor the receiver knows the actual rate realization for each 
transmission, although they are shared with the rate set information. The user then encodes [Nr k \ number 
of data nats, denoted by a message w k , into a packet (codeword) with iV symbols, using a random coding 
scheme specified as in [1][10] and also in the following. For all k G {1, • • • ,K}, we assume that user 
k is equipped with a codebook library C k = {C k e k : 9 k G Q k } in which codebooks are indexed by a set 
Q k . Each codebook has M classes of codewords. The i th (i G {1, • • • , M}) codeword class has |_e Arrfci J 
codewords with the same length of iV symbols. In contrast to a conventional coding scheme, here each 
codeword in the codebook corresponds to a message and rate pair (w k ,r k ) [1][3]. Let C k g k (w k ,r k )j be 
the j th symbol of the codeword corresponding to message and rate pair (w k) r k ) in codebook C k e k - User k 
first selects the codebook by generating 9 k according to a distribution -& k such that the random variables 
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Xi Wkn )j '■ @k — > Cke k {wk-,r k )j are i.i.d. according to an input distribution -Px|rJU- The codebook C k g k is 
then used to map (w k ,r k ) into a codeword, denoted by xi Wk ,r h )- After encoding, the codewords of all 
users are sent to the receiver over the compound channel. 

To simplify the notation, we use bold font variable to denote the corresponding variables of all users. 
For example, w and r denote the messages and communication rates of all users. Px\r denote the input 
distributions of all users, etc. Given a vector variable, say r, we use to denote its element corresponding 
to user i. Let S C {1, • • • , K} be a user subset, and S be its complement. We use r$ to denote the vector 
that is extracted from r with only elements corresponding to users in S. By using the vector notation of 
the channel input symbols, the compound channel set is also denoted by {Py\x> ■ ■ ■ , Py\x}- 

We assume that the receiver is shared with the random codebook generation algorithms and hence knows 
the randomly generated codebooks of all users. Before packet transmission, the receiver pre-determines 
an "operation region" 1Z — {(r, Py\x)}, which is a set of rate vector and channel realization pair, where 
each entry of r is chosen from the corresponding rate set, i.e., r k G • • • , r kM } (k G {1, • • • , K}), 
and Py\x G {-Py]x> ' ' * > Py\x\- Let (r, Py\x) be the actual realization of the transmitted rate vector and 
channel pair. We assume that the receiver intends to decode all messages if (r, Py\x) £ an d intends to 
report a collision if (r, Py\x) ^ Note that the actual rate and channel realization (r, Py\x) is unknown 
at the receiver. Therefore the receiver needs to make decisions whether to decode messages or to report a 
collision only based on the received channel symbols. More specifically, in each time slot, upon receiving 
the channel output symbols y, the receiver estimates the rate and channel pair, denoted by (r,Py\x), 
for all users. The receiver outputs the corresponding estimated message and rate vector pair (w, r) if 
(?S Py\x) ^ H an d a pre-determined decoding error probability requirement is satisfied. Otherwise, the 
receiver reports a collision. Also note that, whether the receiver should recover the messages or report a 
collision not only depends on the rates, but also depends on the channel realization. In other words, for the 
same transmission rate vector, the receiver may be designed to take different actions for different channel 
realizations. This is opposed to the conventional compound channel communication scenario where, if 
a rate is supported by the system, the receiver should always decode the messages irrespective of the 
channel realization. 

Given the operation region 1Z, and conditioned on that (w, r) is transmitted over channel Py\x, 
we define the following three error probabilities. The decoding error probability, for (w, r, Py\x) with 
(r, Py\x) G Tl, is defined as 

Pe( w ,r,p Ylx) = Pr {(w, r) £ (w, r)\(w, r, Py lx )} , V(w, r, P Y \ X ) } (r, P y|x ) G K. (1) 

'The input distribution is assumed to be a function of the communication rate. In other words, different communication rates may correspond 
to different input distributions. 
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The collision miss detection probability, for (w,r, Py\x) with ( r ,-Py|x) ^ is defined as 

P c (w,r,p Y]x ) = 1 -Pr {"collision"| (w,r,P Y \x) \ -Pr{(w 7 r) = (w, r)\(w, r, P Y \x)} , 

y{w,r,P Y \x),(r,PY\x)^n. (2) 

Note that in ©, when (r, Py\x) ^ ^> we have excluded the correct message and rate pair estimation 
from the collision miss detection event. 

Let S C {1, • ■ ■ , K} be an arbitrary user subset. Assume that J2k^s r k < h r , p v\x)(Xs] Y\Xs) for all 
( r 5-Py|x) £ where X s denotes the channel input symbols of users in set S, and Xg denotes the 
channel input symbols of users not in set S. I( r ,p Y}x ) ls the mutual information function computed using 
input distribution corresponding to rate vector r (i.e., Px\r) and channel Py\x- We define the system 
error probability P es as 

P es = maxi max ./aKr,P v ), max w /cKP y|x) L (3) 

The following theorem gives an upper bound on the achievable system error probability P es . 

Theorem 1: Consider if-user multiple random access communication over a compound discrete-time 
memoryless channel {Pypf) * * ' > Py\x}' where H < oo is a positive integer. Let Px\r be the input 
distribution for all users and all rates. Let 1Z be the operation region. Assume finite codeword length N. 
There exists a decoding algorithm, whose system error probability P es is upper bounded by, 

E(r,p Ylx )en,r s =r s exp{-NE m (S, r, r, P Y \x, Py\x)} 

exvi-NEi&rSiPY^P^x)} 



Pes < max < max ^ 

Sc{l,-,K} 



(r,p Ylx )en 



max £ £ max exp{-NEi(S, r, r', P Y \x, P Y \x)} } , (4) 

where E m (S, r, r, Py| X , Py|x) and r, r', Pypt, p Y \x) are S iven b y 

P m (S, r, r, Py\ x , P Y \x) = max -p^f k + max - log EE TT P x \r k (X k ) 

o<p<i r-rt o<s<i "-rf rr^ , 

fc^s - y x 5 fees 

E n Px kfc (x fc )p m (r|x) 1 - s ) [ E II Px k - fc (x fc )p m (r|x)^ 

£7i(5, r, r', Py| X , Pyjx) = max -p E r fc + max - log E E II P *k fc 

° <P " 1 fc05 0<«<1-P y Xskes 



s+p / \ 1— s 



X 



J2U p x\r k (Xk)PY\x(Y\X)^) [J2T[Px K (X k )P Ylx (Y\X)} . (5) 

K X g k£S ) \X S k?S 



The proof of Theorem \T\ is given in Appendix [A] 

When the compound channel is randomly generated at the beginning but remains static afterwards, one 
can take codeword length to infinity to obtain the system error exponent as E s = hmjv->oo — — log P es . The 
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following lower bound on the achievable system error exponent E s can be easily derived from Theorem 

m 

Corollary 1: The system error exponent of a i^-user multiple random access system over compound 
discrete-time memoryless channels given in Theorem Q] is lower-bounded by 

E a >mm{ min min E m (S, r, r, P Y \x, Py\x), 

min min_ E^S, r, r, P Y \x, Py\x) \ , (6) 

SC{1,-,K} (r,P Y]x )eK,(r,P Y{x )fJl, J 

where E m (S, r, f, P Y \x, Py\x) and E^S, r, r, P Y \x, Py\x) are given in ©. 

Compared with the error exponent derived in [3, Corollary 2], we can see that, even though the channel 
stays static forever, the system still needs to pay a penalty in error exponent performance for not knowing 
the channel at the receive^. 

In both Theorem \T\ and Corollary [Q we have assumed that there are only a finite number of channels 
in the compound set. Next, we will extend the result to the case when the cardinality of the compound 
channel set can be infinity. 

We first assume that the the channels in the compound set can be partitioned into H classes, denoted by 
where H < oo is a positive integer. For example, if the compound channel set contains 
fading channels with continuous channel gains, one could quantize the channel gains and define the set 
of channels with the same quantization outcome as one channel class. We next assume that the receiver 
should choose an operation region 1Z to satisfy the following constraint for any rate vector r and channel 
class Fe{F»,---,FWy 

CI: For any (r, J 7 ), either (r, P Y]X ) e K VPy, x G J 7 , or (r, P Y{X ) £ K ^P Y \ X G J= . (7) 

We say (r, J 7 ) e 1Z if (r, Py\x) e ^ f° r all Py\x e and we say (r, J 7 ) 1Z otherwise. 

For each channel class T and for each channel output symbol Y and input symbol vector X, we define 
the following upper and lower bounds on the conditional probability values yielded by channels in J 7 , 
denoted by PL,(Y\X) and P^ m (Y\X), 

PLAY\X) = max P Y{X (Y\X), P^l*) = min P Y{X (Y\X). (8) 

The following theorem gives an upper bound on the achievable system error probability. 

Theorem 2: Consider a i^-user multiple random access communication system over a compound 
discrete-time memoryless channel. Assume that the compound set is partitioned into H classes, denoted 

2 We assume that such a conclusion should be well known for the conventional compound channel communication. However, we are not 
able to find a reference that made such a clear statement. 
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by {j 7 ^, ■ ■ • , J-^H, where i/ is a finite positive integer. Assume that the operation region 1Z satisfies 
constraint CI given in ©. The system error probability P es is upper bounded as follows. 



Pes < max < max 



max exp {— NEAS, r, r', J 7 , J 7 ')} 



+ exp{-NE m {S,r,f,T,f)} 

{r,F)&U,r s =r s 



max 



Y max exp {— iVi^fS, r, r', J 7 , J 7 ')} 

(r,F)eK,rs=r s (r ^ >? K > r S- r S 



(9) 



where E rn (S, r, r, J 7 , J 7 ) and Ei(S, r, r' , J 7 , J 7 ') are given by 

E m (S, r, f, J 7 , J 7 ) = max -pY^r k + max - log ^ E II P xH ( x k) 



kgS Y X s k€S 



X 



£ n Px kfc (x fc )p^ ax (y|x)p^ in (y|x)- s EII Px k - fc (x fc )P^ ax (r|x 

r, r', J 7 , J 7 ') = max -p £ r fc + max - log E E II P ^\r k (X, 

0<p<l 7~7% 0<s<l— p , _ „ 



s+p / \ 1— £ 



X 



E II Px\r k (x k )pL x (y\x)p^ m (Y\x)— [yu p X y k (x k )p^ x (y\x) 

K X s kgS J \Xgk£S 



(10) 



The proof of Theorem |2] is given in Appendix El As shown in the proof that, in order to make decoding 
and collision report decisions, the receiver only needs to search over the finite number of channel classes 
using statistics -P^ax an( l -^min defined in d8]), as opposed to searching among all possible channels. 

III. Individual User Decoding in Random Multiple Access Communication 

In Section HH we have assumed that the receiver either decodes messages or reports collisions for all 
users in the system. In practical applications, even though many users compete for the wireless channel, it 
is common that the receiver may not be interested in recovering messages for all of them. In this section, 
we show that the results obtained in Section [H] can help to derive error probability bounds in a random 
multiple access system where the receiver is only interested in recovering the messages from a user 
subset. However, to simplify the notations, we will only consider a special case when the communication 
channel is known at the receiver, and when the receiver is only interested in decoding for a single user. 
Generalizing the results to decoding for multiple users over a compound channel is straightforward. 

Let the discrete-time memoryless channel be characterized by Py\x, which is known at the receiver. 
In each time slot, each user chooses a communication rate and encodes its message using the random 
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coding scheme described in Section UD The rate information is shared neither among the users nor with the 
receiver. We assume that the receiver is only interested in recovering the message for user k E {1, • • • , K}. 
We assume that the receiver chooses an operation region 1Z, such that if the transmitted rate vector r 
satisfies r E TZ, the receiver intends to decode for user k, and if r ^ TZ, the receiver intends to report 
a collision for user k. It is important to note that, first, whether the receiver will be able to decode the 
message of user k, not only depends on the rate of user k, but also depends on the rate of other users. 
Therefore, the operation rate region TZ should still be defined as a set of rate vector r, as opposed to the 
rate of user k. Second, even though the receiver only cares about the message of user k, the receiver still 
has the option of decoding the messages for some other users if this helps to improve the communication 
performance of user k. This implies that, based upon the received symbols, the receiver will essentially 
need to make a decision on which subset of the messages should be decoded. 

Due to the above understandings, we first define an elementary decoder, called the "(V, 7^x>)-decoder". 
Given a user subset V C {1, • • • , K} and an operation rate region TZd, the "(£>, 7?.£>) -decoder" intends 
to recover messages for users in V while regarding signals from users not in V as interference, if the 
communication rate vector is within the operation region 1Zt>- We define the following error probabilities 
for a (V, 1Zt>) -decoder. Conditioned on users in V transmitting (w£,,r£,) and users not in V choosing 
rate r^, let us denote the estimated messages and rates by (wx>, rv) and f if the decoder does not 
report a collision. We define the decoding error probability of the (V, TZv) -decoder for (wd, r v , r-g,) with 
r E TZx> as 

P e (w v ,r v ,rf,) = Pr{(w v ,r v ) ^ (w v ,r v )\(w v ,r v ,rv)}, V(w v , r v , rf,), r E 1Z V . (11) 

We define the collision miss detection probability for (wx>, td, rf,) with r ^ 7Zx> as 

P c (w-d, rx>, r-p) = 1 - Pr{"collision"|(it;x,,rx,,r^)} - Pr{(w v ,r v ) = (w v ,r v )\(w v ,r v ,rf,)}, 

V(w v ,r v ,rf,),r g K v . (12) 

System error probability of the (V, TZx>) -decoder is defined by 

P es (V,1Z v ) = max <^ max P e (w v ,r v ,rf>), max P c (w v ,r v ,rf,)\ . (13) 

Given a finite codeword length N, the following lemma gives an upper bound on the achievable system 
error probability of a (V, 7^x>) -decoder. 

Lemma 1: The following system error probability bound is achievable for a fT-user random multiple 
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access communication system over a discrete-time memoryless channel Py\x with an (V, TZ-p) -decoder, 



P es (T>, IZd) < max < 



max 



E 

scv 



^2 exp{-NE mV (S,r,r)} + max exp{-NE iV (S, r, r')} 

r s = r s 

r s =r s 



max V y~] max exp{— NE iT >(S, r, r')} } , 

f ^ R ' D ScV Z r> tn-o, 
r' =T S 



(14) 



where E mT >{S, r, r) and E iT >(S, r, r') are given by, 

E mV (S, r, f) = max -/) ^ r t + max - log ^ E II P x\n {X k 



k£V\S 



Y X s kcS 



x I E II Px^X^PiY^rv) 1 -*) II Px\r k {Xk)P{Y\X v ,rv) 

K x vxs kev\s J Xx^kevxs 

E W (S, r, r') = max -p J2 r k + . max - log J2 E II P x\r k (X k ) 

u<p - kcv\s - p y x s kes 

E U Px\ rk (X k )P(Y\X v ,r t )^) J J] Px K (X k )P(Y\X v ,r'v)\ .(15) 

Xj,\ s kcV\S J \Xv\ s k£V\S 

with P(Y\X- D ,rf > ) in the above equations defined as 



P(Y\X V ,V t ) = Y.U P X \r k (X k )Py lX (Y\X) 

Xf, k ev 



(16) 



Proof: Since the decoder regards signals from users not in V as interference, given that users not in V 
choose rate r^, the multiple access channel experienced by users in V is characterized by P{Y\Xx>, rf,) as 
specified in (fT6l) . The system can therefore be regarded as a random multiple access system with \V\ users 
communicating over a compound channel characterized by the set {P(Y\Xx>, 7"£>)|Vr-p}. Consequently, 
Lemma \T\ is implied directly by Theorem [Q ■ 
Next, we will come back to the system where the receiver is only interested in the message of user 
k. We assume that for each user subset PC {1, ■ • • , K} with k E V, the receiver assigns an operation 
region 1Zt> Q TZ for the (V, IZv) -decoder. That is, if the transmission rate r satisfies r £ IZ-p, the receiver 
intends to use the (V, 1Zt>) -decoder to recover the message of user k. It is easy to see that we should 
have, 

n= (J n v . (17) 

V:VC{l,--,K},k£V 

Assume that the receiver (single-user decoder) carries out all the (V, IZv) -decoding operations. The 
receiver outputs an estimated message w k for user k if at least one {V, TZ^) -decoder outputs an estimated 
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message, and all estimation outputs of the (V, TZv) -decoders for user k are identical. Otherwise, the 
receiver reports a collision for user k. 

Let the transmitted rate vector be r, and the transmitted message of user k be w k . We define the 
decoding error probability P e (w k ,r), the collision miss detection probability P c (w k ,r) and the system 
error probability P es as follows, 

P e (w k ,r) = Pr{(w k ,f k ) ^ (w k ,r k )\(w k ,r)} ,V(w k ,r),r e TZ, 

P c (w k ,r) = 1 - Pr {"collision"! (w k ,r)} - Pr{(w k ,r k ) = (w k ,r k )\(w k ,r)} ,V(w k ,r),r £ TZ, 
P es = max < max P e (w k ,r), max P c (w k ,r)>. (18) 

{(■w k ,r),reTZ (w k ,r),r£1l J 

The following theorem gives an upper bound on the achievable system error probability of the single-user 
decoder. 

Theorem 3: Consider a fT-user random multiple access system over a discrete-time memoryless chan- 
nel Py\x, with the receiver only interested in recovering the message for user k. Assume the receiver 
chooses an operation region TZ. Let a be an arbitrary partitioning of the operation region TZ satisfying 

TZ= |J TZv, 

V:T>C{l,-,K},keD 

TZ V , HTZ V = <f>,VD,V C {1,---,K},V ^V,k eV,V. (19) 
System error probability of the single-user decoder is upper-bounded by, 

Pes < mm Yl P es (V,TZ v ), (20) 

V:VC{l,--,K},keV 

where P es (V,TZx>) is the system error probability bound of the (V, TZv) -decoder, and can be further 
bounded by ([I4|>. ■ 

Proof: Because a (V, TZx>) -decoder can always choose to report a collision even if it can decode 
the messages, its system error probability can be improved by shrinking the operation region TZv- This 
implies that the receiver of the random access system should partition its operation region TZ into TZv 
regions that do not overlap with each other. In other words, replacing (fTTT) by (fT9l will improve the system 
error performance. The rest of the proof is implied by Lemma Q] ■ 
Note that the system error probability bound provided in Theorem [3] is implicit since the optimal 
partitioning scheme a that maximize the right hand side of (|20l) is not specified. To find the optimal 
partitioning, one essentially needs to compute every single term on the right hand side of (l20l) and (fT4l) 
for all rate options and all user subsets. Because both E m v(S,r,r) and Eiv(S,r,r') defined in (fT5l) 
involve the combinations of two user subsets and two rate vectors, the computational complexity of 
finding the optimal partitioning scheme is O ((2M) 2K ). 
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IV. Conclusions 

We investigated the error performance of the random multiple access system over a compound discrete- 
time memoryless channel. An achievable bound on the system error probability was derived under the 
non- asymptotic assumption of a finite codeword length. We showed that the results can be extended to 
the random multiple access system where the receiver is only interested in decoding messages for a user 
subset. 

Appendix 

A. Proof of Theorem [7] 

We assume that the following decoding algorithm is used at the receiver. Given the received channel 
output symbols y, the receiver outputs a message and rate vector pair (w, r) together with a channel 
realization Py\x such that (r, Py\x) G 72- if the following condition is satisfied, for all user subsets 

-^\ogPr{y\x {W:r) ,P Y \x} < ~ log Pr{y\x iibt f), P Y \x}, 

for all (w,r,P Y \ x ), (w s ,f s ) = (w s ,r s ), (w k ,f k ) ^ (w k ,r k ),Vk £ <S, 
and (w, r, P Y \x), (w, r, Py\x) e K(s, v ), with 

n (s,y) = {(&,f,Py\ X )\ {r,pY\x) e K,-—logPr{y\x {ib} r),P Y \x} < T (r,P Ylx ,s)(y)] > (21) 

where T (f P Y]X s)(') ls a per-determined typicality threshold function of the channel output symbols y, 
associated with the rate and channel realization pair (f, P Y \x) and the user subset S. If there is no 
codeword satisfying (I2TT) . the receiver reports a collision. In other words, for a given S, the receiver 
searches for the subset of codewords with likelihood values larger than the corresponding typicality 
threshold. If the subset is not empty, the receiver outputs the codeword with the maximum likelihood 
value as the estimate for this given S. If the estimates for all S C {1, ■ • • , K} agree with each other, the 
receiver regards this estimate as the decoding decision and outputs the corresponding decoded message 
and rate pair. Otherwise, the receiver reports a collision. Note that in (TfTT) . for given S and (w, r), we only 
compare the likelihood value of codeword vector Xi w ,r) with those of the codeword vectors satisfying 
(w s ,r s ) = (w s ,r s ), (wk,fk) 7^ (wfc,r fc ),VA; ^ S. We will first analyze the error performance for each 
user subset S and then derive the overall error performance by taking the union over all S. 

Given a user subset S C {1, • • ■ , K}, we define the following probability terms. 

First, assume (w,r) is transmitted over channel P Y \x, with (r,Py\x) £ Let Pt[ r ,p Ylx ,s] be the 
probability that the likelihood value of the transmitted codeword vector over the channel P Y \x is no 
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larger than the corresponding typicality threshold, 

Pt{r,p nx ,s] = Pr {P(y\x {w , r) , P Y \x) < e- Nr ^x^ iy) } . 



(22) 



Define P m ^ r p Y x ) (f p Y x ) s] as tne probability that the likelihood value of the transmitted codeword vector 
over the channel realization Py\x is no larger than that of another codeword (w, r) with (ibs, fs) = 
(w s ,r s ), (w k ,r k ) (w k ,r k ),\/k £ S, over channel P Y \x with (r,P Y \x) G ft, 



m[(r,PY\ X ),(r,P Y \x),S] 



Pr {P(y\x( w>r ), P Y \x) < P(y\x^ t f),PY\x)} 



[w, r, Py\ x ), 0, Py\x) e 11, (w s , f s ) = (w s , r s ), (w k , r k ) ^ (w k , r k ),Wk <£ S. 



(23) 



Second, assume that (w, r) is transmitted over channel Py\x, with (r, Py\x) ^ Define P^~ p Y . x ^ ( r p Y x ) s] 
as the probability that the decoder finds a codeword (w,r) with (ws,rs) = (ws,fs),(w k ,r k ) ^ 
(w k ,f k ),Wk S, over channel Py\x with (r,Py\x) £ 7£> such mat its likelihood value is larger than the 
corresponding typicality threshold, 



P 



H(r,P Y \x),(r,P Ylx ),S 



Pr {P(y\x {Wtr)j P Y \x) > e 



- Nr (r-,P YIX ,S)(V) 



} 



(w,r,P Y \x), (r,Py\x) e ft, (w s ,r s ) = (w s ,r s ), (w k ,r k ) ^ (w k ,r k ),Vk <£ S. (24) 

With the above probability definitions, by applying the union bound over all S, we can upper-bound 
the system error probability by 

maX(r,P Y}x )eR,Y,Sc{l,~;K} [Pt[r,P Ylx ,S] + ^(f,P Y[x )en,r s =r s Pm[{r,P Ylx ),(r,P Y \x),S}_ 



P pq < max 



max 



(r 



P Y \ X )tK T,SC{1,-,K} J2(r,P Y}x )eTZ,r s =r s P i[(r,P Ylx ),(r,P Ylx ),S] 



.(25) 



Next, we will derive individual upper-bounds for each of the probability terms on the right hand side of 
Step I: Upper-bounding P m [(r,p Ylx Ur,p Ylx ),s] 

Denote Eg as the expectation operator over random variable 9 which is defined in Section HO Conse- 



quently, given (r,P Y]x ), {r,P Y \x) e K, P m \ (r ,R 



l(r,P Y \ X ),(,r,P Y]x ),S) 



P m[(r,P Ylx ),(r,P Y]x ),S] ~ E 



X 



defined in (1231 can be rewritten as 



(v) 



(w,r),PY\x)(fim{(r,P Ylx ),(r,P Y \ x ),S_ 



(26) 



where m[(r p y|x)i( - p y|x)i(S] (y) = 1 if P(y\x (w>r) , P Y{X ) < P(y\x iib> f), Py\x) f or some triplet (w, f, P Y \ X ) 
with (f, P Y \x) e H, {w s ,r s ) = (w s ,r s ), {w k ,r k ) ^ (w k ,r k ),\/k <£ S. Otherwise, m [( r ,jv, x ),(f.A'|x).5]( l/ ' 
0. We can upper-bound m [(r,Py| X ),(f,Py| X ),«s](y) f° r an y constants p > and s > as follows, 

< J > m[(T,Pr iX ),(T,Py lx )iSl(v) ^ 



wXws,fs)=(w s ,r s ),(u} k ,f k )^(wk,r k )yk 



iS P(y\X(w,r), Py\x] 



P{y\X( Wir ),P Y \ Xj 



(27) 
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Substituting (1271 ) back into (1261 ) gives, 

J2P(y\X( w ,r),PY\x) 



P rn[(r,PY\xUr,P Y \x),S] ^ E 



X 



E 



w,(w s ,fs)=(ws,rs),(w k ,f k )^(w k ,r k 



• fc ),Vfc05- P (l/| aj («,f),-fV|Jlc)'' 



£7? 



P(2/|cc(„, ]r .),Pr|x) p 
P(y|a; (l „ )T . ) ,Py| X ) 1 "''- 



J2 P(y\x { ^P Ylx )- P .(28) 

_-u;,(ibs,r s )=(ii) S ,r s ),(w fc ,f fc )^(«i fc ,r fc ),Vfc^5 J J _ 

The second step in ((281) is due to the independence between the codewords corresponding to (w^,rg) 
and (wg,fg). 

With the assumption of < p < 1, we can further bound P m [(r,p Y , x ),(r ,P Y \x) s] ^Y 



3/ 



),<S] < H ^ 



Ea 



P{y\X( W; r),PY\x) 



1-s 



xE ds 



0s 



P(y|iE( &)f ;),pK|x 

P(y\x (w , rh P Ylx ) l - s 



E 0g 



P(y\x { a, : r )} PY\x) p 



(29) 



It is easy to verify that the bound in (1291) holds for all < p < 1 and s > 0, and becomes trivial for 
s > 1 . Consequently, (1291) gives the following upper bound, 

p m[ (r,p y|x ),(f.,p y|x) ,5] < ex P {~NE m (S, r, r, P Y]X , P Y[X )} , (30) 

where E m (S, r, r, P Y \ X , Py\x) is specified in ©. 
Step II: Upper-bounding P t [ r ,p Y]X ,s} 

Given that (r,P Y \ x ) G 71, we can rewrite -Pt[ r ,p y | X ,s] 5 defined in ([III) , as follows, 



Pt[r,Py| X ,5] - ^0 



$3i 3 (|/|sB(f O ,r),-fV|Jir)0t[r,JV|x.S](l/) 



(31) 



where (j) t [r,P nx ,s]{y) = 1 if P(y\x {w , r ), Py\x) < e NT (r,p Y[X ,s) v ^ ot herwise (j>t[r,p Y]x ,s](y) = 0. Note 
that the value of T( r ,p Y}x ,s)(y) will be determined in Step IV. Similarly, we can bound <j>t[r,p Y < x ,s](y), for 
any si > 0, as follows, 

e 



-N Sl T {ri p Y S) (y) 



(l>t[r,P Y \ x ,S](y) ^ 



P(y\x iw , r) ,P Y \ X ) Si 



(32) 



This yields, 



t[r,P Y , x ,S] 



< Ea 



Y^E es [E e§ [P{y\x {w ^P Y \ x ) 1 - 



-NsiT {r ,p Y]x> s)(v) 



(33) 
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Step III: Upper-Bounding P i[{ r,P Y]xUr ,p Y]x ),s] 
Given r 1Z and r ElZ, we rewrite Pi[(f,p Y]X ),(r,p Yl x),s] 



as 



P i[(r,PY\x),(r,P Yl x),S] ~ E & 



i y 



(34) 



where ^[(f, J FV|x).(*-.JV|x).si ^ = 1 if there exists a triplet r ' Py \ x ^ with ( r > Pi 1*) G ^' ( w s, r s) 
(w s ,r s ), and (w k ,r k ) ^ (w k ,h) for all k ^ S, such that P(i/|x(„, r ), iV|jc) > e 
satisfied. Otherwise, [{ r,p y|x ),(r,p y|x ),5](2/) = °- 

For any s 2 > and p > 0, 0[(f,p y|x ),(r,p r | X ),s](2/) can be bounded by, 



E 



^[(r,Pr|x),(r,Py|x),5](^) ^ 

Substituting d35]) into CP} yields, 

P iK*,PY\x),(.r,P Y \x),S] 



w,(ws, rs)=(ws,rs),( w k,rk)¥ : ('tik,rk)Vk 



2 

•4S P (y\X(w,r), Py\X) T 



e ~N s -fr {r , Pnx , s) (y) 



< 



E^[P(?/^(^),i S y|x)e 7Vs2T( ^'- S)(3/) 



s 

J2 P(y\x( w , r ),Pr\x)~ 

w,(ws,rs)=(ws,rs) 

The independence between (11)5,7*5) and (it^rj) allows us to rewrite the above bound as 



P 



i[(r,P Y \x),( 



r,P Y] x),S] - H E <>s 

y 



E °s 



P(y\x^ )f) ,P Y \x) 



^Ns 2 T {r ^p Y S) (y) 



xE 9s 



P(y\X( w , r ),PY\X. 

_w,(w s ,r s )=(w s ,r s ) 

With the assumption of < p < 1, the inequality in (1371) becomes 



P i[(r,P Y \x),(r,P Yl x),S] < Z E S [ E 0§ [ P (v\ X ,r), Py\x) 



xEg- {[p(y\x( Wir) , P Y \x) * 



< 



max 



(r>,p Y]x )tny s =r s y 



J2 E > 



0s 



Ea 



y e N S2T ( v,P Y]x ,S)(y) e NpJ2 k<i LS V k 

P(y\ X {w',r'), Py\X 



IS 



(35) 



(36) 



(37) 



(38) 



xE 9g {[p(y\x iw , rh P Ylx )f ]y e Ns ^ X ^e N ^^ . 

Note that the upper bound in (1381) is no longer a function of (r§, Py\x)- 
Step IV: Choosing r^p Y]XtS )(y) 

The value of T(t,p Y \x,s){u) can be determined by jointly optimizing the bounds in (|33l) and (|38l) . 
Consequently, given (r,P Y \x) 6 K, 2/ and auxiliary variables si > 0, s 2 > 0, < p < 1, we choose 
T (r,P Y \x,s){y) sucn tn at the following equality is satisfied, 



l-si 



■P(!/|a5(tt,r),-fV|X 



-Ar S ir (7 ,, Py|x , s) (3/) 



{[P(y|« ( „, r)|J fV|x)^ }Ye Ns2T ^^ {y) e N ^Hs^. (39 ) 
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where (r*,P Y \x) is defined a; 



argmax ^ Eg s 



Ea,, 



P(y\x {w , yh Py lx ] 



xEo s { [P(y\x (w , r) , P Ylx )f } y e Ns ^^ iy) e N ^^ 



(40) 



Finding a solution for (|39l ) is always possible since that the left hand side of (|39l ) decreases with 
T (r-,p Ylx ,s)(y), while the right hand side of (|39| ) increases with T( ri p r|JCi s)(?/). This yields the desired 
typicality threshold, denoted by r£. Py x 5 )(y), which gives 



+"2 



{Ee s [P{y\x iWtr) ,P Ylx y-^]}^ 



l+ a 2 



(41) 



Substituting (ED into (f33l) . we get 



s l+ s 2 



(42) 



Let s 2 < p and si = 1 — s ?-, and then do a variable change with p 



P(P~ S 2) 
p-(l-p)S2 



and s = 1 



P~S2 



p-(l-p)s 2 ' 



Consequently, inequality (|42|) becomes, 



N 



x\Y.U p x\r k (X k )P Y \x(Y\X)^) (Y,T[Px K (X k )P Y]x (Y\X)) \ .(43) 

K X s k£S J \X g k£S J J 

Similarly, we can obtain the same upper bound for Pi[(?,p Y , x ) (r,p Y]x ),s] as gi ven at me right hand side of 
(|43l . Since (@3]> holds for all < p < 1 and < s < 1 - p, we have 



• P t[r,iY|x,S]>- P ir(f,P> 



),(r,P Y \x),S] 



< max exp (-NEAS, r.r'Py \x, Pi 



(r',P y|x )^,r^=r s 

where Ei(S, r, r', Py|x, Py\x) * s gi ven m ©• 

By substituting (l30l) and ((44]) into (|25T) . we get the desired result. 



Y\X) f J 



(44) 



'Although the notation of to* is used in l |39l l, the result is actually invariant to any choice of the message vector. 
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B. Proof of Theorem [2] 

We assume that the following decoding algorithm is used at the receiver. Given the channel output 
sequence y, the receiver outputs a message and rate vector pair (w, r) together with a channel class T 
such that (r, T) G 1Z if for all user subset S C {1, ■ • • , K}, the following condition is satisfied, 

-^\ogPr{y\x {W}r) ,P^} < -— log Pr{y\x {ib> f),P^ 3X } , 

for all (w,r, J*), (w s ,f s ) = (w s ,r s ), (w k ,f k ) ^ {w k ,r k ),\/k £ S, 
and (w, r, P£ in ), (w, r, P^ ax ) G n {s , y ), with 

K {s ,y) = {(w,f,F*)|(f,.F) G n,--Pr{y\x {ib)f) ,P fi } < r { ~ P ^ s) (y)} , (45) 

where r,~ p ^ 5 ^(-) is the typicality threshold function. Again, we will first analyze the error performance 
for each individual S and then derive the overall error performance by taking the union over all S. 

For a given user subset S C {1, • • ■ , K}, the following probability terms are defined. 

First, assume that (w, r) is transmitted over channel Py\x £ J 7 , with (r,^) G 1Z. Let Pt[ r ,F,p Y \ X ,s} be 
the probability that the likelihood value of the transmitted codeword vector calculated using P^ in is no 
larger than the corresponding typicality threshold, 

Pt Wnx ,s] = Pr [P{y\x [w , r) , P£ in ) < e~ NT ^ p ^ (y) } . (46) 

Define P m ^ r ^ ^ ^ Py]x 5 j as the probability that the likelihood value of the transmitted codeword vector 
calculated using P^ in is no larger than that of another codeword (w, r) with (w s , r s ) = (w s , r s ), (w k , f k ) 
(w k ,r k ),Vk ^ S, calculated using P^ ax with (r,F) G 1Z, 

Pm[(r,T),(r,T),P Y \x,S] = ^ T {P(v\ X (w,r) , P^in) — P(y\ x (w,r) , P^ax) } 

(w, r, F), (f, j°) G K, (w s , r s ) = (w s , r s ), (w k , f k ) ^ (w k , r k ), VA; S. (47) 

Second, assume that (w, r) is transmitted over channel Py\x G J 7 , with (r, .F) ^ 71. Define P^~ ^ ^ ^ p y ^ 5 j 
as the probability that the decoder finds a codeword (w, r) with (ws,rs) = (ws,fs),(w k ,r k ) ^ 
(w k , f k ), VA; ^ 5, over channel class J 7 with (r, F) G 7?., such that its likelihood value calculated using 
P^ m is larger than the corresponding typicality threshold, 

Pi[(,,n { r,nPr ]x ,s] = Pr {p(y\x (w , rh P^ a ) > e - NT ^ p ^ {y) } , 

(w, r, F), (r, F) G TZ, (w s , r s ) = (w s , r s ), (w k , r k ) ^ (w k , f k ), VA: 5. (48) 

Consequently, the system error probability P es can be upper-bounded using the above probabilities 
terms as follows, 



Pp, < max < 



maX (r,Py| X ) : Py| X eJ,(r,J)eK Y,SC{1,- -,K} 



P 



*[r,^,JV|x.5] 



max 



+ T,(f,f)eR,rs=r s Pm[(r,T),(r,T),P Ylx ,S] 
(f,P Y \ X )-.P Y \ X eT,{r,P)$n £sc{l,-,*r} F)€K,r s =r s Pi[(f,f),(r,F),P Y]x ,S] 



(49) 
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Note that we have used the union bound over all user subsets S to obtain the probability bound in (|49l) . 
Next, we will derive individual bound for each of the probability terms on the right hand side of (|49l ). 
A derivation similar to (I26l)-d30l) in Appendix [A] gives the upper bound on P m ^ r ^)^f t),p y , x s] as ' 



P 



m[(r,T),(r,T),P Y}x ,S] 



< e Np ^s fk Y,Ee s \e 0s \P(y\x {w>r) , P Ylx )P(y\x {w>r) , P£ in , 



E e§ [P( 



U\X{w^r)i Pi 



< exp{-NE m (S,r,r,F,F)} 



(50) 



where E m (S, r, r, J 7 , J 7 ) is given in (fTOl) . Note that the second inequality in (|50l) is due to the fact that 
P(y\xr w ,r), Py\x) < P(y\ x (w,r), Pmax), an d the right hand side of (1501 ) is not a function of Py\x- 

Similarly, by using the same bounding techniques as in (f3TT)-d33T) and (l34l)- (|38l) in Appendix [A] we can 
upper bound P t [ r ,T,p Y , x ,s} for any s x > by, 



t[r,F,P Y \ X ,S] ^ Z^^Os 

y 



< EEe 
y 

< H E 0s 



Efi 



■T \-si 
min/ 



P(y\X(w,r), Py\x)P(v\B(w,t), P r 

P(y\x {w>r) , P^ x )P(y\x {w , r) , P£J~ S1 



(r,Px". ,S) 

g mm 



g v mm ' 



(y) 
(y) 



(51) 



and upper bound P i[{i .,T),{r,T),p Y \x,s] for an Y s 2 > 0, < p < 1 by, 



P. 



i[(r,J-),(r,J-),P 5 



|X,S] < E^e 



P(l/|0J(t8,f), A'ix) 



E es {[P(y\x {w , r) ,P< n ) P \\ e (r ' p m^ e 



'k 



< 



max 



{r',F>)tn,T> s =r s y 



05 



max/ 



X 



#05 {[-P(l/|a5(t«,r),-Pmin) * 



(52) 



Note that the upper bound given in (I5TT) is not a function of Py|x- Similarly, the bound in (152b is not a 
function of Py\x- 

Optimization of the typicality threshold r, p t s) can be carried out using the similar technique as 

' min' ' 

introduced in (I39l)-d4n) in Appendix [A] By substituting the optimal tv_ p t s) into (I5TI ) and (|52l , we get 

> ' min' t 

Ptlr,T,p Ylx ,s],P t[{ ^ Ur ^,p Ylx ^ < ^max^expf-iV^^r^', J 7 , if')} , (53) 
where Ei(S, r, r' , J 7 , J 7 ') is given in (fTOl) . 
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Combining ([501) , (1531) and (@9]), we obtain 

-Pes < max < max 

(r,P Y]x ):P Y]x £T,(r,T)£ll „ 



SC{1,-,K} I 



E 



max 



+ E 



cxp 



{-NE m (S,r,r,F,7)} 



(f,T)£'R.,r s =r s 



max 



5C{1,-,K} L(T-,J")e7i,T-s=f5 



E E 



max 
(r' ,F')pl,r' £ 



s= r s 



exp{-NE t (S,r,r 



J 7 , J")} (54) 




Since the upper bounds given in (1501 and (|53l ) are not functions of individual channels (but functions of 
channel classes), the right hand side of (|54|) can be simplified to the right hand side of ©. 



[1] J. Luo and A. Ephremides, A New Channel Coding Approach for Random Access with Bursty Traffic, to appear in IEEE Trans, on 



[2] J. Massey and P. Mathys, The Collision Channel Without Feedback, IEEE Trans, on Inform. Theory, Vol. IT-31, pp. 192-204, Mar. 1985. 
[3] Z. Wang and J. Luo, Error Performance of Channel Coding in Random Access Communication, submitted to IEEE Trans, on Inform. 

Theory. |http://arxiv.org/abs/1010.0642| 
[4] A. Lapidoth and P. Narayan, Reliable Communication under Channel Uncertainty, IEEE Trans. Inform. Theory, Vol. 44, pp. 2148-177, 

Oct. 1998. 

[5] D. Blackwell, L. Breiman, and A. Thomasian, The capacity of A Class of Channels, Ann. Math. Statist., Vol. 30, pp. 1229-241, 1959. 
[6] J. Wolfowitz, Simultaneous Channels, Arch. Rational Mech. and Anal., Vol. 4, pp. 371-86, 1959. 
[7] T. Cover and J. Thomas, Elements of Information Theory, 2nd Ed.,Wiley Interscience, 2005. 

[8] I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, New York: Academic, 1981. 
[9] D. Bertsekas and R. Gallager, Data Network, 2nd Ed., Prentice Hall, 1992. 

[10] S. Shamai, I. Teletar, and S. Verdu, Fountain Capacity, IEEE Trans. Inform. Theory, Vol. 53, pp. 4372-4376, Nov. 2007. 



References 



Inform. Theory. 



